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Cauchy-Schwarz Inequality 


6.2.4 Cauchy-Schwarz Inequality 

You might have seen the Cauchy-Schwarz inequality in your linear algebra course. The same 
inequality is valid for random variables. Let us state and prove the Cauchy-Schwarz inequality 
for random variables. 


Cauchy-Schwarz Inequality 
For any two random variables X and Y , we have 

\EXY\ < JE[X 2 ]E\Y 2 \, 

where equality holds if and only if X — OlY , for some constant OL G M. 


You can prove the Cauchy-Schwarz inequality with the same methods that we used to prove 
\P{X,Y)\ < 1 in Section 5.3.1. Here we provide another proof. Define the random 
variable W — (X — CtY) 2 . Clearly, W is a nonnegative random variable for any value of 
a G M. Thus, we obtain 


0 < EW = E(X-aY) 2 

= E[X 2 - 2aXY + a 2 Y 2 ] 

= E[X 2 \ - 2 aE[XY] + a 2 E[Y 2 }. 

So, if we let/(ct) = E[X <2 ‘) — 2 OiE\XY] + ct 2 £/[l A2 ], then we know that 
/(«) > 0, for all oi. G R. Moreover, if /(ct) = 0 for some ct, then we have 

EW = E(X — aY) 2 — 0, which essentially means X = OiY with probability one. 

EXY 

To prove the Cauchy-Schwarz inequality, choose Q. — — 2 . We obtain 

0 < 


E[X 2 ] - 2 aE[XY] + a 2 E[Y 2 } 
E[X 2 ] 

E[X 2 ] 


2 ^E[XY] + { -^E[Y 2 } 

(E[XY \) 2 


(. EY 2 ) 


EY‘ 
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Thus, we conclude 

(. E[XY ]) 2 < E[X 2 ]E[Y 2 ], 

which implies 

\EXY\ < J E[X 2 \E\Y 2 }. 

Also, if |_EXy| = y/E[X 2 \E[Y 2 ], we conclude that / ( ) = 0, which implies 

X — EXY Y with probability one. 

BY 2 


Example 6.23 

Using the Cauchy-Schwarz inequality, show that for any two random variables X and Y 

\p(X,Y)\ < 1. 

Also, | p(X, Y) | = 1 if and only if Y — aX + b for some constants a, b G M. 


Solution 
o Let 


u = 


X-EX 
°x 


V = 


Y-EY 

g y 


Then EU — EV — 0, and Var[U) — Var(V ) = 1. Using the 
Cauchy-Schwarz inequality for U and V, we obtain 


\EUV\ < ^E[U Z ]E[V Z ] = 1. 

But note that EUV — p(X,Y^), thus we conclude 

\p(X,Y)\ < 1, 

where equality holds if and only if V — QiU for some constant Oi G M. That is 

Y-EY X-EX 
- = a -, 


g y 


crx 


which implies 
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Y = + (EY - C ^-EX). 

°x °X 

In the Solved Problems section, we provide a generalization of the Cauchy- 
Schwrarz inequality, called Holder's inequality. 


previous 
next —*■ 
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